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© An I/O Processor includes a two channel receiver (28b) and a two channel transmitter (28c) coupled to a 
high speed communications channel. For the receiver a status memory, specifically a FIFO, stores structuring 
information that indicates the beginnings and endings of PACKETS, as well as, for each BURST of data words 
within a packet, an indication of the occurrence of the BURST and a length L of the BURST. Additionally, there 
is an indication for each BURST of the presence of any errors occurring during the BURST. A corresponding 
data FIFO contains only the received data words, without any structuring information. A device reads both of the 
FIFOs, subsequent to the reception of one or more PACKETS, so as to reconstruct the original format of the 
received data. For the transmitter a structure control FIFO stores the structuring information for an associated 
data FIFO (40c, 40d), the transmitted data being structured in accordance with the structuring information. The 
receiver and the transmitter each include a high speed internal data path (42a, 42b) and a lower speed data path 
which are coupled together during slave read and write cycles, and which are decoupled during high speed 
DMA cycles. 
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This invention relates generally to data communications and, in particular, to method and apparatus for 
providing high bandwidth data communications for a data processor system, such as a multiprocessor 
system. 

System requirements needed to interact with and visualize large, time-dependent simulation data sets 
5 include a large, high-bandwidth disk array to store the entire data set being processed, a high speed data 
communications network to download a problem set, a large, high-speed memory to buffer all data required 
to process a single simulation time step, computational power that is adequate to manipulate, enhance, and 
visualize the data sets, and a real-time, high resolution visual display. Furthermore, it is important that these 
functions be provided within a highly programmable and flexible user environment. 
70 To realize such large and complex systems a multiprocessor approach may be taken, wherein a 
plurality of data processors operate in parallel on the same aspect or on different aspects of the same task. 

An important consideration in such a multiprocessor system is the interfacing of the system to external 
data sources, such as supercomputers and high capacity disk arrays. 

It is thus one object of the invention to provide an intelligent I/O Processor for coupling to high speed 
75 data communications channels. 

It is another object of the invention to provide an I/O Processor that facilitates high speed direct 
memory accesses (DMA) to or from a shared global system memory over high speed interconnects. 

It is a further object of the invention to provide an I/O Processor that facilitates the management of 
communication data information and structuring information for use with a communication protocol that 
20 employs packets of information bursts, such as an ANSI standard High Performance Parallel Interface 
(HIPPI). 

The foregoing objects are realized by an I/O Processor that includes a receiver and a transmitter 
coupled to a high speed communications channel. For the receiver a status memory device, specifically a 
First In-First Out (FIFO) memory device, stores structuring information that indicates the beginnings (SOP) 

25 and endings (EOP) of packets, as well as, for each BURST of data words within a packet, an indication of 
the occurrence of the BURST and a length (L) of the BURST. Additionally, there is an indication for each 
BURST of the presence of any errors occurring during the BURST. A corresponding data FIFO contains 
only the received data words, without any structuring information. A device, such as an attached I/O data 
processor or communications controller, is enabled to read both of the FIFOs, subsequent to the reception 

30 of one or more PACKETS, so as to reconstruct the original format of the received data words. 

For the transmitter a control structure FIFO is initially loaded, prior to a transmission, by the I/O data 
processor to store the structuring information that indicates SOP, EOP, BURST, and L for each BURST. A 
data FIFO is also initially loaded, preferably through a DMA mechanism, with the data words that 
correspond to the structuring information stored within the control structure FIFO. The transmitter operates 

35 to reconstruct the format of the transmitted data words by reading the control structure FIFO in conjunction 
with the unstructured data from the data FIFO. The control structure FIFO may also store a LINK bit with 
each control for causing consecutive control indications to be linked together. 

The I/O Processor also includes, for the transmitter and for the receiver, a DMA control FIFO wherein a 
plurality of DMA commands may be stored and linked together to cause a plurality of DMA commands to 

40 be executed in sequence, without intervention by the I/O data processor. 

The I/O Processor further includes, for the transmitter and for the receiver, a plurality of internal buses. 
One bus is a high speed data bus coupled to the data FIFOs that is used for transferring data, typically by 
DMA, to or from a global memory. Another bus is a slower speed data bus used for slave read/write cycles 
of I/O Processor registers and other logical devices. The two buses are coupled together during slave 

45 cycles and are decoupled during DMA cycles. During DMA cycles the data is transferred in a high speed 
manner over the high speed bus while the slower speed bus is used for transferring DMA-related command, 
status, and control information. 

The above set forth and other features of the invention are made more apparent in the ensuing Detailed 
Description of the Invention when read in conjunction with the attached Drawing, wherein: 

50 Fig. 1 illustrates system components of a scientific visualization system; 
Fig. 2a is a block diagram of the system server component of Fig. 1; 

Fig. 2b is a block diagram showing in greater detail a coupling of signals between the receiver and 

the transmitter of Fig. 2a; 
Fig. 3 illustrates communications channel signals during the transmission of three data bursts; 
55 Fig. 4 is a block diagram of the HIPPI receiver shown in Fig. 2a; 

Fig. 5 is a block diagram of the HIPPI transmitter shown in Fig. 2a; 

Fig. 6a shows the content of a receive status FIFO at the termination of the communications 
sequence shown in Fig. 3; 
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Fig. 6b shows the content of the receive data FIFO at the termination of the communications 
sequence shown in Fig. 3; 

Fig. 7a shows the content of a transmit control FIFO at the beginning of the communications 
sequence shown in Fig. 3; 

5 Fig. 7b shows the content of the transmit data FIFO at the beginning of the communications 
sequence shown in Fig. 3; 

Fig. 8 illustrates receiver control logic and, in particular, a plurality of state machines that implement 

the Bus Controller State Machine of Fig. 4; 
Fig. 9 illustrates transmitter control logic and, in particular, a plurality of state machines that 
70 implement the Bus Controller State Machine of Fig. 5; 

Fig. 10 depicts a state diagram implemented by the RFDC and the ROBC elements of Fig. 8; 

Fig. 11 depicts a state diagram implemented by a RQRW_1 and a RQRW_2 state machine of Fig. 

8; 

Fig. 12 illustrates the state diagram implemented by the RCQC element of the DMA CRS state 

75 machine of Fig. 8; 

Fig. 13 depicts a state diagram implemented by a RSTC_1 and a RSTC_2 state machine of Fig. 8; 
and 

Fig. 14 depicts a state diagram of two interrelated state machines for controlling the D and B buses 
of Fig. 4. 

20 Referring to Fig. 1 there is illustrated a multiprocessor system that includes an I/O processor (IOP) that 
is constructed and operated in accordance with the invention. Specifically, there are illustrated components 
of a Scientific Visualization System (SVS) 10. A purpose of the SVS 10 is to process, manipulate, and 
visualize complex data sets at interactive speeds, although the use of the system 10 is not limited to only 
this one important application. Furthermore, and as will become apparent, the use of the I/O processor is 

25 not restricted to only this particular system. That is, the IOP as taught by the invention may be employed to 
advantage in a number of different types of multiprocessor systems. 

The SVS 10 includes several major components. A first component is a server 12 embodied within a 
data processing system that provides large-scale computational power, high-speed memory, and intelligent 
I/O processors, all of which are interconnected by a high speed global bus. The terms global bus, shared 

30 bus, and common interconnect are used interchangeably herein. 

A second component is a console 14 embodied in, by example, a RISC System/6000 (RS/6000) data 
processing system manufactured by the International Business Machines Corporation (RISC System/6000 is 
a Trademark of the International Business Machines Corporation). The console 14 provides network access 
from remote workstations (not shown). 

35 A third component is a Frame buffer 16 that includes a RS/6000 data processor which provides console 
functions therefore. Frame buffer 16 includes interface and image buffering hardware 16a attached via an 
ANSI standard High Performance Parallel Interface (HIPPI) for providing real-time display capability to high- 
resolution displays 18. A further component of the system 10 is a disk array 20. Disk array 20 may be 
embodied within a storage system having 21 GByte capacity with 55 MByte/second transfer rate via a HIPPI 

40 interface. 

It should be realized that the exact configuration of the system 10 varies depending on the intended use 
and that the configuration of Fig. 1 is not intended to represent a limitation upon the practice of the 
invention. 

Referring to Fig. 2a there is illustrated in block diagram form the server 12 of the SVS 10. Server 12 is 
45 comprised of a plurality of individual processors 22a organized as four processors (P0-P3) per printed 
circuit card 22. The server 12 may include up to eight cards for a total of 32 processors. Each processor 
card 22 includes a universal bus interface (UBIF) 34 for coupling a Local Processor Card (LPC) bus 32 to a 
SVS global bus 24. Also coupled to the SVS global bus 24 are a plurality of Global Memory cards 26, a 
plurality of I/O processor cards 28, and an interface 30 to the RS/6000 console 14. 
so More specifically, each processor card 22 includes up to four processor nodes each having a 
microprocessor 22a. In a present embodiment each microprocessor 22a is an i860-type device, specifically 
an 80860 microprocessor device manufactured by Intel Corporation (i860 is a Trademark of the Intel 
Corporation). Coupled to each microprocessor 22a through a node bus 23 is a local node memory 22b 
providing, in this embodiment, 16 megabytes (MB) of storage. Each processor node also includes a 
55 buffered interface 22c to the LPC bus 32. Additionally, each processor node includes an interface 22d to a 
serial bus (S). The LPC bus 32 connects multiple processor nodes to the UBIF 34 and also permits access 
to further shared resources. 

In a present embodiment one of the processor cards 22 is capable of a peak performance of 160 million 
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instructions per second (MIPS), or 320 million single precision floating point operations per second 
(MFLOPS). A fully configured system of eight processor cards 22 provides a peak performance approach- 
ing 1.28 billion instructions per second (BIPS) or 2.56 GFLOPS, assuming 40 MHz operation. 

Also in a present embodiment each of the Global Memory cards 26 is configured with either 128 MB or 
5 256 MB of random access memory with ECC. The server 12 may include up to four Global Memory cards 
26. Each of the Global Memory cards 26 provides a data bandwidth of 640 MB/second in a manner that 
reduces a memory access latency seen by each user of the system 10. This is accomplished by 
partitioning the Global Memory on each memory card 26 into four memory banks (B0-B3), each of which is 
capable of independently performing block read cycles, page mode read or write cycles and random read 
w or write cycles. A Global Memory Card (GMC) bus 26a enables each of the banks (B0-B3) to operate 
independently, while utilizing common global bus resources. 

The I/O processor cards 28 each include a processor node 28a, similar to processor node 22a of the 
processor card 22, in addition to two HIPPI receivers 28b, and two HIPPI transmitters 28C. Each IOP 28 
provides four HIPPI interfaces, each of which is capable of operation at a transfer rate of 100 MB/second. 
75 The HIPPI interfaces are employed to support high speed disk arrays, provide real-time images to HIPPI- 
attached frame buffers, and realize high speed communication with external devices, such as supercom- 
puters. The I/O processors 28 are described in detail below. 

The console interface 30 is partitioned into two cards, one which is found within the server 12 and one 
which resides in the console 14. The link between the two card allows access to the Global memory 26 and 
20 serial bus, which in turn allows access to each processor's local memory and PBIF. 

The system 10 also includes an Arbiter 36 that is coupled to the Global Bus 24 and which operates to 
arbitrate requests for the Global Bus between the processors 22, the memory 26, console interface 30, and 
the I/O processors 28. 

The Global Bus 24 is implemented with Emitter Coupled Logic (ECL) technology for interconnecting 
25 these various components and providing a 1.28 GByte/sec transfer rate. 

Each SVS 10 server 12 supports up to 12 master devices (i.e. processor cards 22, I/O processor cards 
28, or Interface card 30), and up to four memory cards 26. One possible configuration includes an Interface 
card 30, eight processor cards 22 (or 32 processors), four Global Memory cards 26 each with 256 MBytes 
of storage for a total of 1024 MB of high speed memory, and one I/O processor 28 to support the high 
30 speed disk array 20, receive data from a HIPPI source, and distribute image data to HIPPI attached frame 
buffers 16. The console 14 provides a user interface to the SVS 10 as well as support for standard I/O 
devices. 

As can be seen in Fig. 2a each component card of the system 10 includes one of the UBIFs 34. The 
UBIF 34 presents a shared, synchronous, decoupled interface to the Global Bus 24, provides local 

35 arbitration for the LPC bus 32 or GMC bus 26a, and performs all necessary handshaking and retry 
sequencing with the Global bus 24. In a present embodiment the UBIF 34 provides bidirectional, pipelined 
buffering in support of to four local master devices, such as processors 22a, or up to four slave devices, 
such as the memory banks B1-B4. The UBIF 34 supports data bus widths between eight bits and 256 bits 
and provides a peak data transfer rate of 1 .28 Gbytes/second between the Local Bus 32 and the Global Bus 

40 24, assuming 40 MHz bus operation (25 nanosecond bus cycle). 

For the I/O processor cards 28 the associated UBIF 34 provides an input and an output data queue for 
the processor 28a (Queues 0), an input and an output data queue for the HIPPI receiver 28b (Queues 2), 
and an input and an output data queue for the HIPPI transmitter 28c (Queues 3). UBIF 34 input and output 
queues (1) are presently not used. An aspect of the invention is a sharing of the transmitter's 28c UBIF 34 

45 output queue by the receiver 28b for DMA cycles, and a sharing of the receiver's 28b UBIF 34 input queue 
by the transmitter 28c for DMA cycles. This aspect of the invention is described in greater detail below. 

In accordance with the present invention the I/O processor cards 28 each include a processor node 28a, 
similar to the processor card 22, plus two HIPPI transmitters 28c, and two HIPPI receivers 28b. Each IOP 28 
thus provides four HIPPI interfaces, each of which is capable of operation at a transfer rate of 100 

so MB/second. The two receives channels 28b and the two transmitters channels 28c operate independently to 
deliver 100 Mbytes/second each. The HIPPI interfaces are employed, by example, to support high speed 
disk arrays, provide real-time images to HIPPI-attached frame buffers, and provide high speed communica- 
tion with external devices, such as supercomputers. 

The HIPPI communications channels conform electrically and logically to a specification entitled "High- 

55 Performance Parallel Interface Mechanical, Electrical, and Signalling Protocol Specification (HPPI-PH)" 
preliminary draft proposed, American National Standard for Information Systems, November 1, 1989, 
X3T9/88-127, X3T9. 3/88-032, REV 6.9, the disclosure of which is incorporated by reference herein. 

Fig. 3 is an illustrative timing diagram showing a synchronous transfer of three data bursts from a 
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source (S) to a destination (D). Each data burst has associated therewith a length/longitudinal redundancy 
checkword (LLRC) that is sent from the source to the destination on a 32-bit data bus during a first clock 
period following a data burst. Packets of data bursts are delimited by a PACKET signal being true. The 
BURST signal is a delimiter marking a group of words on the HIPPI data bus as a burst. The BURST signal 

5 is asserted by the source with the first word of the burst and is deasserted with the final word. Each burst 
may contain from one to 256 32-bit data words. A burst having less than 256 words is considered to be a 
"short burst". A packet is defined to contain no more than one short burst, which may be either the first or 
last burst of a packet. A REQUEST signal is asserted by the source to notify the destination that a 
connection is desired. The CONNECT signal is asserted by the destination in response to a REQUEST. 

10 One or more READY indications are sent by the destination after a connection is established, that is, after 
CONNECT is asserted. The destination sends one ready indication for each burst that it is prepared to 
accept from the source. A plurality of READY indications may be sent from the destination to the source to 
indicate a number of bursts that the destination is ready to receive. For each READY indication received, 
the source has permission to send one burst. Not shown in Fig. 3 is a CLOCK signal defined to be a 

75 symmetrical signal having a period of 40 nanoseconds (25 MHz) which is employed to synchronously time 
the transmission of data words and the various control signals. 

As in the case of the processor nodes 22a the IOP 28 includes the 600MByte/sec local on-card bus 
(LPC 32). The LPC bus 32 includes a 256-bit data bus (LPC D) 32a and a 32-bit address bus (LPC A 32b). 
A description of the LPC bus 32 signals is found in Appendix A. Several logical units are attached to the 

20 LPC bus 32. As seen in Fig. 2a, these logical units include the UBIF 34 and the local processor node 28a, 
which includes 16 megabytes of private memory. Also attached to the LPC bus 32 are the two HIPPI 
receivers 28b and the two HIPPI transmitters 28c. 

As seen in Figs. 3 and 4 each of the two, two-channel HIPPI interfaces 28b and 28c has the same 
overall organization. The two independent HIPPI interfaces, receiver or transmitter, convert data between the 

25 differential ECL signals used on the HIPPI interface and the TTL/CMOS levels used internally within the IOP 
28. The interfaces 28b and 28c also implement the specified state machines that control the signalling 
between a HIPPI receiver and transmitter regarding the establishment of connections and the management 
of data buffers. 

The data is transferred to or from data FIFOs (40a, 40b, 40c, 40d), each of which has two independent 

30 clocks enabling the synchronization of the 25 MHz frequency of the HIPPI interfaces and the nominal 
40MHz clock rate of the SVS 10. The FIFOs 40a-40d also perform the function of matching the 32-bit width 
of the data on the HIPPI channel and the 64-bit width of an internal interface 28b or 28c data bus (DBUS) 
42a and 42c, respectively. 

In addition to the data FIFOs 40a-40d there are two other FIFOs for each of the four HIPPI channels. 

35 One of these stores structure information concerning the communication data stream. As was stated, the 
HIPPI specification enables data to be sent in packets which consist of one or more bursts, with each burst 
containing up to 256 data words. In the HIPPI receiver interfaces 28b the incoming data is split into (a) data 
and (b) structure information. The data is written into the data FIFOs 40a and 40b and the structure 
information is written into status FIFOs 44a and 44b. 

40 As is shown in Fig. 6a the status FIFOs 44 contain entries that indicate the beginnings (SOP) and 
endings (EOP) of packets, as well as, for each burst, the length (L) of the burst. Additionally, there is an 
indication for each burst of the presence of any errors (E) in the burst. As seen in Fig. 6b, the 
corresponding data FIFO 40a or 40b contains only received data, without any structuring information. 

In the transmitter interface 28c the structure information for a given channel is first stored within 

45 Structure Control FIFOs (SCF) 46a or 46b by the local processor 28a. This structure information is 
subsequently read out of the appropriate FIFO 46a or 46b by the HIPPI transmitter interface and is used to 
structure data which is read by the transmitter interface 29c and 29d, from the data FIFO 40c(d), into 
packets of bursts of specified length. There is a stored record in the SCF 46a(b) containing entries that 
indicate the beginnings and endings of packets, as well the length of each burst. For the transmitter 

so interface 28c the SCF 46 also contains a bit which is used to link together the execution of the controls 
contained in the FIFO 46. Once the HIPPI transmitter begins operation it continues to read controls from the 
appropriate one of the SCFs 46, and data from the associated data FIFO 40c or 40d, as long as the controls 
are linked together by the link bits. 

A third FIFO for each channel is employed to store DMA commands, and is referred to as a command 

55 FIFO (CF) 48. Each DMA command specifies the transfer of from one to 256 bursts, of length 256 words, 
between Global memory 26 and the associated HIPPI channel. The CFs 48a, 48b, 48c and 48d store 1024 
commands and, for each command, store a starting block address, a length in full bursts, and bits which 
indicate whether to link the execution of successive commands and whether to interrupt the I/O processor 
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28a upon the completion of the command. The CFs 48 thus provide a mechanism that enables DMA 
operation over a number of consecutive DMA commands. 

Other elements of the two channel receiver 28b or or transmitter 28c include a 256 bit registered 
bidirectional data buffer DB 50 which functions as an interface between the LPC data bus 32a and the 64-bit 

5 private data bus (DBUS) 42. In accordance with an aspect of the invention a bidirectional transceiver 52a 
couples the DBUS 42 to a further 64-bit data bus referred to as the BBUS 54a. As can be seen, the DBUS 
42a is not as heavily loaded as the BBUS 54a (seven bus loads as compared to 13) and is thus inherently 
capable of higher speed operation. The higher speed DBUS 42a has the data FIFOs 40 coupled thereto for 
transferring during DMA cycles, in a high speed manner, data to or from the LPC DBUS 32a. For non-DMA 

io accesses (slave cycles), such as processor 28a read or write accesses to components on the DBUS 54a, 
the transceiver B2D 52 couples the DBUS 42 to the BBUS 54. 

Thus, in accordance with a further aspect of the invention there is provided an I/O processor that 
includes a high speed internal bus for transferring communication data and a lower speed internal bus for 
transferring command, status, and control information. Furthermore, while communication data is being 

15 transferred to or from the data FIFOs 40 B2D 52b isolates the BBUS 54 from the DBUS 42, enabling DMA 
command, address, and sequencing information to be simultaneously transferred between logical units 
coupled to the BBUS 54. 

The receiver and transmitter interfaces also include an address buffer AB 56 for bidirectionally coupling 
the LPC ABUS 32b to an internal address bus (ABUS) 58. 
20 Other components shown in Figs. 4 and 5 are described in detail below. 

RECEIVER 28b 

A more detailed description of the operations of the HIPPI receiver (HPR) 28b is now provided. The 

25 overall data path architecture of the HPR 28b is shown in Fig. 4. The HPR 28b provides two HIPPI receiver 
channels. The purpose of the HPR 28b is to enable data transferred from one or two external HIPPI 
transmitters to be received into Global memory 26 by DMA transfer, or to be read out by the processor 28a 
using memory mapped I/O accesses. Additional features of the HPR 28b provide support for the 
implementation of the HIPPI specification by combined hardware and software mechanisms, allow for the 

30 efficient control of the interface so that a minimum of processor 28a intervention is required to effect a 
transfer, to allow for the transfer of data at the full 200 MB bandwidth of the two channels, to allow for the 
recovery from error conditions, and to enable diagnostic testing of the interface. 

The HPR 28b is partitioned into two independent HIPPI receiver sections 29a and 29b which provide 
the electrical interface to the HIPPI channels and which implement the specified control sequences and 

35 connection and buffer management policies. 

With respect to the LPC 32 the HPR 28b is both a master for DMA memory writes to Global Memory 
26 and a slave for control register reads and writes by processor 28a. By means of slave operations the 
processor 28a is enabled to reset the interface, to read status and write control registers, to read data from 
data FIFOs 40a and 40b which has been received from each of the channels, to store a channel program 

40 within CF 48 to control the operation of a DMA sequencer state machine, and to recover the structure of 
received data in accordance with the structure information within SFs 44. As a bus master, by means of 
DMA transfers, the HPR 28b transfers blocks of received data, via LPC 32 and UBIF 34, directly into Global 
memory 26 under the control of a sequence of DMA commands stored in command FIFOs 48a and 48b, in 
conjunction with a DMA register 60a and other logical units. DMA block transfers are multiples of 1024 

45 bytes and transfer data to blocks of Global memory 26 that are aligned on 1KB boundaries. DMA transfers 
for the two HIPPI channels are interleaved on a block by block basis (blocked multiplexed). If both channels 
29a and 29b are simultaneously active they alternately transfer 1KB blocks. 

As data is received by the two receiver sections 29a and 29b the data is stored into the corresponding 
data FIFOs 40a and 40b, respectively, without any indication of how the data was originally organized. In 

50 order to enable the subsequent reconstruction of the data, each receiver also writes into the status FIFOs 
44a and 44b a sequence of status words indicating variously the start of a packet, each burst contained 
within the packet, with the length of burst in 32-bit words, an error indication for the burst, and an end of a 
packet. The contents of each status FIFO 44 are readable through the slave interface or each may be 
automatically read by a DMA sequencer state machine, described in detail below, over the BBUS 54a and 

55 compared against the DMA commands stored in the associated command FIFO 48, stopping in the event of 
an error or a mismatch. 

The HPR 28b slave interface provides for the reading and writing of the various control and status 
registers that implement the interface described above. Each of these registers is described in detail below. 
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An overview is now given of the control registers. The addressable facilities of the HPR 28b are 
memory mapped in a physical address block of the address space of the processor 28a. Addressable 
objects include normal registers and pseudo-registers, such as FIFO buffers, interrupt registers, and reset 
registers, which do not have conventional memory semantics but which support read-like and write-like 
5 operations. The processor 28a addressable registers are summarized in Table 1. 



TABLE 1 



NAME 


DESCRIPTION 


DMA 60a 


DMA control and status register (CSR) 


CSRO 62a 


HIPPI channel 0 CSR 


CSR1 62b 


HIPPI channel 1 CSR 


INT 64a 


Interrupt source register 


MSK 66a 


Interrupt mask register 


CFO 48a 


Channel 0 command FIFO 


CF1 48b 


Channel 1 command FIFO 


SF0 44a 


Channel 0 status FIFO 


SF1 44b 


Channel 1 status FIFO 


DFO 40a 


Channel 0 data FIFO 


DF1 40b 


Channel 1 data FIFO 



More specifically, the receiver DMA register 60a provides control and status information for the LPC bus 
32 interface and DMA controller. A portion of this register determines the mode of DMA operation. 

Specifically, one bit, if set, enables the DMA transfer of data to Global Memory 26 from either receiver 
channel 29a or 29b that is READY. Two bits are used to enable the reading and staging for execution of 
DMA commands for a particular one of the channels. Another bit enables Processor ID (PID) sharing for 
DMA Global Memory 26 writes. If this bit is set, alternate writes to the Global Memory 26, via the UBIF 34 
data queues, use Write Request-2 (WREQ<2» and Write Request-3 (WREQ<3>). If this bit is cleared all 
Global Memory 26 writes use WREQ<2>. This aspect of the invention regarding PID sharing is described in 
further detail below. 

Another bit of the DMA register 60a enables a flow mode for DMA command execution. If set, each 
DMA command executed from the command FIFOs 48a and 48b requires a corresponding status word in 
the status FIFOs 44a and 44b that matches the command. Both FIFOs 44 and 48 are read simultaneously. If 
this bit is not set DMA commands are executed independently of the contents of the status FIFOs 44. 

In addition to the foregoing, the DMA register 60a also contains a five bit read/write field that is used to 
provide the high order five bits of the physical memory address for DMA Global Memory 26 write data. 
These additional address bits are employed to address beyond the four GByte limit imposed by the 32-bit 
byte address of the ABUS 58. 

Eight bits of the DMA register 60a provide status concerning the DMA controller, while four bits provide 
information concerning the status flags of the data FIFO 40 and command FIFO 48. These flags include a 
FULL flag, a HALF FULL flag, an ALMOST EMPTY flag, and an EMPTY flag. 

Several other bits provide strobes when a corresponding bit is written with a one. These strobes enable 
the starting of a DMA operation for either of the channels. 

The RCSR(0) 72a and RCSR(1) 72b provide control and status for the HIPPI receivers 29a and 29b. 
Specifically, certain of these bits are programmed to enable the corresponding receiver to respond to an 
external transmitter, which has asserted REQUEST, by asserting the CONNECT signal. Reference is again 
made to the timing diagram of Fig. 3. Another bit, if set, enables the receiver to establish the connection. If 
not set, the receiver performs a reject sequence by asserting the CONNECT signal for four cycles and then 
deasserting the signal. Other bits enable the receivers to send one or more READY indications to the 
external transmitter. Other bits of this register, when read, provide an indication of the current state of the 
control signals on the associated HIPPI channel. These control signals include REQUEST, CONNECT, 
PACKET, BURST, and READY. Further bits of this register provide full and empty flags for the status FIFOs 
44a and 44b. 

The RCSR registers 72a and 72b also contain a number of bits that indicate error conditions. These 
include received data parity error conditions, LLRC errors, length errors, and ready errors. 

The INT register 64a and the MASK register 66a provide control over the generation of interrupts to the 
local processor 28a and also provide status concerning interrupts which have been asserted. These 
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interrupts include a RING interrupt which indicates that an attached transmitter has asserted the REQUEST 
signal. The above mentioned error conditions also generate an ERROR interrupt. 

The DMA command FIFOs CF(0) 48a and CF(1) 48b are each also partitioned into a plurality of fields. 
For each FIFO storage location eight bits define a repeat count field. Each command may be executed a 

5 plurality of times (1-256), as indicated by the content of the repeat count field. Another field contains bits 
DMA, LINK, and INTR. If the DMA bit is set there is indicated a command that is a data transfer command. 
If this bit is not set the command functions as a NO-OP, except that the LINK and INTR bits are still 
operational. If set, the LINK bit indicates that upon completion of a current command that the next command 
should be executed automatically without restarting the channel DMA controller. The use of this bit thus 

w enables the automatic execution of a plurality of consecutive DMA commands without intervention. The 
INTR bit, when set, causes a DMA completion interrupt to be generated upon the successful completion of 
the associated command. 

Twenty-two bits of each command FIFO 48 location contain a portion of the address used for the DMA 
transfer. In that all DMA transfers begin on a 1024 byte boundary, the low order 10 bits of the DMA address 

75 are implicitly zero. The high order five bits of the DMA address are provided, as previously mentioned, from 
the DMA register 60a. During a DMA transfer to Global Memory 26, the address of a 32-byte memory word 
(256-bits) is provided from a separate address counter (AC) 49a, that is loaded from the DMA register 60a 
(5-MSB bits) and the command FIFO 48. 

As was previously described, the Status FIFOs, SF(0) 44a and SF(1) 44b, contain status bits which 

20 describe the structure of the received data. As seen in Fig. 6a, these FIFOs contain a BURST indication, a 
SOP indication, an EOP indication, and a length of a received BURST. An error indication is also provided 
to indicate if a given BURST was received with errors, such as parity or LLRC errors. 

The Data FIFOs, DF(0) 40a and DF(1) 40b, are each written by the associated HIPPI receiver 29 as data 
is received over the attached HIPPI channel. The FIFOs may be read under software control either 64-bits 

25 or 256-bits at a time. These FIFOs are also read and their contents written to the Global Memory 26 by the 
DMA controller, via DBUS 42a, LPC bus 32, UBIF 34, and Global Bus 24. The DFs 40a and 40b each store 
from zero to 8,192 bytes of data. 

In addition to the addressable registers shown in Table 1 the HPR 28b includes a plurality of non- 
addressable registers which are loaded and read-out by control lines generated by state machines. 

30 Specifically, the HPR includes a bus controller state machine (BCSM) 68a and a pair of HIPPI receiver state 
machines (HRSM) 70a (only one of which is shown in Fig. 4). Each HIPPI receiver channel 29a and 29b is 
controlled by an associated one of the HRSM 70a state machines. Each HRSM 70a implements the 
specified HIPPI protocols so as to control the connection to and the reception of data from external HIPPI 
sources. The BCSM 68a has outputs coupled to various ones of the registers and controls the operation and 

35 linking of the DBUS 42a and the BBUS 54a for both DMA and programmed I/O reads and writes, and also 
generally controls the sequencing of DMA operations. The operation of various constituent state machines 
of the BCSM 68a are described in further detail below. 

The non-addressable registers, and other logical elements shown in Fig. 4, include the following as 
described in Table 2. 
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TABLE 2 
NAME DESCRIPTION 

RCRO 72a Channel 0 repeat count register used 
for DMA, includes a DMA block counter 

RCR1 72b Channel 1 repeat count register used 
for DMA, includes a DMA block counter 

*s DAR 74a DMA address register 

SAR 76a Slave address register 

B2D 52a Bidirectional bus transceiver 



20 



25 



30 



35 



DB 50a Four, 64-bit bidirectional data 

buffers that interface the 64-bit DBUS 
42b to the 256-bit LPC DBUS 32a 

AB 56a 32-bit address buffer that interfaces 

the internal A bus 58a to the LPC A bus 
32b 

E/T 78a Channel 0 ECL/TTL converter 
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E/T 78b Channel 1 ECL/TTL converter 



REG 80a Channel 0 input 32-bit register 
REG 80b Channel 1 input 32-bit register 
D(0) BUS 82a Channel 0 32-bit data bus 
D(l) BUS 82b Channel 1 32-bit data bus 
PAR 84a Channel 0 parity checker 
PAR 84b Channel 1 parity checker 
LLRC 86a Channel 0 LLRC generator /checker 
LLRC 86b Channel 1 LLRC generator/ checker 
LEN 88a Channel 0 burst length counter 
LEN 88b Channel 1 burst length counter 



35 

TRANSMITTER 28c 

Having described the operation of the HIPPI receivers 28b a description is now made of the HIPPI 
transmitters (HPT) 28c. As can been seen by a comparison of Figs. 4 and 5 the transmitter architecture is 

40 fundamentally identical to that of the receiver. The HPT 28c also includes a bus controller state machine 
(BCSM) 68b and a pair of HIPPI transmitter state machines (HTSM) 70b (only one of which is shown in Fig. 
5). Each HIPPI transmitter channel 29c and 29d is controlled by an associated one of the HTSM 70b state 
machines. Each HTSM 70b implements the specified HIPPI protocols so as to control the connection to and 
the transmission of data to external HIPPI receivers. The BCSM 68b has outputs coupled to various ones of 

45 the registers and controls the operation and linking of the DBUS 42b and the BBUS 54b for both DMA and 
programmed I/O reads and writes, and also generally controls the sequencing of DMA operations. 

One difference between the HPR 28b and the HPT 28c is in the use of the Structure Control FIFOs 
(SCF) 46c and 46d which provide structuring information to the HIPPI transmitters 29c and 29d, respec- 
tively. As seen in Fig. 7a the SCFs 46c and 46d store the structuring information (SOP, BURST, BURST 

so length (L), and EOP) and also store LINK (Li) information to indicate that successive commands are linked, 
that is, intended to be automatically executed in sequence. 

In general, the various bits referred to above in the addressable registers of the receiver 28b have their 
transmitter-analogs in the transmitter registers. For example, the DMA register 60b includes bits to enable 
the reading and staging for executing transmitter DMA commands for each of the channels. DMA register 

55 60b also contains a bit that enables the flow mode for DMA command execution. Other bits contain the five 
bit extended address used for DMA Global Memory 26 reads, as opposed to Global Memory 26 writes for 
the receivers 28b. 

The CSR(0) 62c and CSR(1) 62d registers contain bits for establishing connections with external HIPPI 
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receivers. For example one of the bits, if set, enables the assertion of a connection REQUEST by the 
associated transmitter channel. Another bit, which is read only, indicates whether the attached receiver has 
accepted or rejected a connection request. Another bit enables the execution of control words from the SCF 
46 by the transmitters 29c and 29d. 

5 With respect to the LPC bus 32, the HPT 28c is both a master for DMA Global Memory 26 reads and a 
slave for control register reads and writes by the processor 28a. By means of slave operations the 
processor 28a may reset the interface, may read status and write control registers, may write the data 
which is to be sent by each of the channels, may store a Channel program* to control the operation of the 
DMA controller (embodied in the BCSM 68b), and may specify the structure of the data to be sent as 

70 packets consisting of bursts. As a bus master, by means of DMA transfers, the HPT 28c transfers blocks of 
data directly from Global Memory 26, under the control of a sequence of DMA commands stored in the 
command FIFOs 48c and 48d, and in conjunction with the DMA register 60b. DMA block transfers are in 
multiples of 1024 bytes and transfer the data from blocks of Global Memory 26 that are aligned on 1KB 
boundaries. DMA transfers for the two channels 29c and 29d are interleaved on a block by block basis 

75 (block multiplexed). As in the receiver 28b, if both channels 29c and 29d are active, then they transfer 
alternate 1024 byte blocks. 

As data is sent from the two transmitters 29c and 29d data words are read out from the data FIFOs 40c 
and 40d, respectively (Fig. 7b). As was previously stated, the data stored in these FIFOs does not contain 
any indication of how the data should be organized. However, the transmitter 29c also reads from the SCFs 

20 46c and 46d the sequence of structure control words which indicate variously the start of a packet, each 
burst contained in the packet, with its length, and the end of a packet. The HIPPI transmitters 29c and 29d 
structure the outgoing data in accordance with the information contained within the SCFs 46c and 46d. The 
contents of the SCFs 46c and 46d are writeable through the slave interface or, in accordance with an aspect 
of the invention, can be automatically written by the DMA controller as DMA commands are completed. This 

25 feature is referred to the aforementioned FLOW mode. 

STATE MACHINES 

Having described the register structure of the receiver interface 28b and the transmitter interface 28c a 

30 description is now provided of the control mechanisms therefore. The description is given in the context of 
the receiver BCSM 68a, it being realized that the transmitter BCSM 68b operates in a similar fashion in 
transmitting data to an external HIPPI receiver. 

Referring to Fig. 8 there is illustrated a plurality of state machine devices linked together by a state bus 
90a. Specifically, there is illustrated an LPC bus 32 interface controller LPC_BIC 92a, a DMA command 

35 read/scheduler DMA CRS 94a, a DBUS controller 96a for controlling the operation of the DBUS 42a, and a 

BBUS controller 98a for controlling the operation of the BBUS 54a. The illustrated structure is hierarchical in 

nature, with the LPC_BIC 92a and DMA CRS 94a being considered an upper level control section and the 

DBUS controller 96a and BBUS controller 98a being considered a lower level. During DMA transfers the 
DMA__ CRS 94a provides signals to the DBUS controller 96a and BBUS controller 98a to control the data 

40 buses for writing data over DBUS 42a to Global Memory 26 and for controlling the flow of DMA status and 
control information on BBUS 54a. 

Two sets of signals control the actions of the lower level control section. The first is comprised of a set 
of STATE signals SLBSY, DBSY, and CRBSY. 

SLBSY is asserted whenever a valid read or write slave cycle, having an address corresponding to the 

45 HPR 28b, is detected. This signal is asserted by the LPC_BIC 92a constituent block RSLB. This signal is 
held until near the end of the completion of the slave cycle. That is, this signal being asserted implies that a 
slave cycle is pending or is active and is used to inhibit the latching of new slave addresses into the slave 
address register (SAR) 76a. This signal being asserted also inhibits the generation of ACKs on the LPC bus 
32 and also controls the start of a slave cycle that utilizes the BBUS 54a. 

so The signal DBSY is employed to indicate that a data transfer is occurring between the LPC data buffers 
50a and the DBUS 42a. This data transfer may be the result of either a DMA cycle from DF(0) 40a or DF(1) 
40b, or the result of the data transfer portion of a slave cycle. This signal is employed to inhibit the start of 
a new slave cycle. 

CRBSY is employed to indicate that a DMA command read cycle is taking place on the BBUS 54a. This 
55 signal is also used to inhibit the start of a slave cycle. 

As was previously stated, during a slave cycle the BBUS 54a and the DBUS 42a are coupled together 
through the B2D 52a buffer so as to function as one bus. During DMA transfers these two buses are 
decoupled by B2D 52a, with DMA data transfers taking place on the DBUS 42a and DMA command reads 
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taking place on the BBUS 54a. All of these transfers have similar timing characteristics. All BBUS 54a 
transfers require 4-5 cycles, with the data being present on the BBUS 54a for at least four cycles. DMA 
transfers also occur in five clock cycle periods, with the data being present for four cycles. 

Fig. 14 illustrates two inter-related state machines for the DBUS 42a and the BBUS 54a. Each of the 
5 data path controllers in Fig. 8 implement variants of these two state machines. In Fig. 14 the states 
connected by dotted lines are considered to be 'locked' together and occur synchronously. All other states 
operate independently. 

Specifically, if SLBSY is active all data path controllers go to the START state and wait until DBSY and 
CRBSY are no longer active. A transition is then made to either a SLAVE 1 or SLAVE 2 state, depending on 
w whether the impending bus transaction requires four or five cycle operation. FIFO reads require five cycles 
while all other reads require four cycles. If SLBSY is not active then DMA data and/or DMA command read 
cycles may take place. The DMA cycles return to the DMA 1 state and repeat until a block of data is 
transferred. 

The second set of signals referred to above is the slave address bus 100a. Three of the low order slave 
is address bits (SA<2:0>), in conjunction with the LPC_RW (read/write) bit, are latched during the execution of 
a slave cycle to control the operation of the data path controllers. These signals determine the direction of 
the buses, which register or FIFO to read/write, and other related functions. Other slave address bus 100a 
signal include Advance (ADV), WIDE, and CHAN, which are indicators of FIFO access types and data 
widths. 

20 Referring again to Fig. 8 a discussion is now made of the DBUS 42a controller 96a, specifically the 
receiver data FIFO controller (RDFC) and the receiver output buffer controller (ROBC). Both of these DBUS 
state machines have as inputs the signals indicated on the state bus 90a and the slave bus 100a. The 
ROBC has outputs for controlling the LPC data output buffer 50a (Fig. 4) and signals, such as DBSY, that 
indicate that the DBUS 42a is transferring data, that a DMA transfer is occurring, that the data buffer 50a is 

25 busy, and that an LPC bus 32 write cycle is required. 

Fig. 10 illustrates the state machine implemented by these devices. The START state is entered from a 
reset. If a slave read cycle is pending it waits until any DMA command read is finished (CRBSY) and the 
output buffer 50a is free. When these conditions occur one of the slave timing chains is entered. The DFn 
chains read data FIFOs 40a and 40b without advance (0), with advance by 64 bits (1), or with advance by 

30 256 bits (4), as determined by the value of the ADV and WIDE signals from slave bus 100. The advance 
function, when disabled, enables the FIFO to be read without advancing the FIFO pointer. When enabled, 
the advance function causes the FIFO pointer to be automatically incremented by a predetermined amount, 
as indicated by SIZE. The SLAVE chain is employed for all other slave read cycles. Slave write cycles idle 
at START until SLBSY clears. If a slave operation is not pending, and if one of the channels is ready for 

35 DMA (RDMA0, RDMA1), and if DMA has been enabled (DMAEN), and if a current DMA burst has not yet 
finished, then the DMA chain is started at DMA-1. For this case, at DMA-1, the state machine waits for DB 
50a to clear and then progresses through the chains of states. At the completion of all of the chains, if a 
slave operation is pending (SLBSY), or the current DMA burst has completed, the state machine returns to 
START. Otherwise, the state machine returns to DMA-1 to complete the transfer of the current DMA burst of 

40 data to Global Memory 26. 

The LPC__BIC 92a shown in Fig. 8 implements the LPC bus 32 interface control, control of the DMA 
address counter (AC 49a), and provides address recognition (decode) for slave cycles. 

As was previously noted, a feature of the IOP 28 is the sharing of processor IDs (PIDs) between the 
receiver interface 28b and transmitter interface 28c. The receiver initiates two types of LPC bus 32 cycles: 

45 Global memory write cycles of DMA data, and local read reply cycles for local processor 28a slave reads. 

In each case the receiver interface 28b causes a LPC bus 32 write request (WREQ<2>) to be made, and 
holds the request active until a grant (GNT<2>) is received from the associated UBIF 34. In order to increase 
Global Memory 26 write bandwidth, the receiver interface 28b interleaves Global Memory 26 writes across 
two different local bus unit IDs. As was previously noted, the UBIF 34 maintains separate output queues for 

so each Local bus 32 unit. That is, a separate output queue is maintained for the processor 28a, the receiver 
28b, and the transmitter 28c. In accordance with a REQ/GNT/ACK protocol the UBIF 34 issues one write to 
the Global bus 24 each seven cycles for a given LPC bus 32 logical unit. Thus, by using two of UBIF 34 
output queues, the receiver 28b achieves a five cycle write. In that the transmitter 28c does not normally 
require Global Memory 26 writes, the receiver 28b 'borrows' the transmitter's unit ID (PID) so as to utilize 

55 the transmitter's UBIF 34 output data queue. This interaction between the receiver 28b and transmitter 28c 
is controlled by a pair of signals, ASK3 and USE3, as seen in Fig. 2b. The receiver 28b asserts ASK3 
requesting the transmitter 28c to make a write request to the UBIF 34 using WRECK3), the transmitter's 
write request line. The transmitter 28c waits until it is able to make the request and then asserts USE3 to 
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the receiver 28b, along with the WREQ<3) to the UBIF 34, to inform the receiver 28b that any grant 
occurring on LPC bus 32 signal line PGNT<3> is for use by the receiver 28b. The transmitter removes 
WREQ<3> and USE3 when PGNT<3> occurs. The receiver 28b monitors the PGNT<3> signal line so as to 
retrieve the requested data from the UBIF 34. This mode of operation is optional under the control of the 

5 before-mentioned bit in the RDMA register (PPEN). If the bit is not set, all receiver write requests are 
performed using WRECK2X 

Related to the request/grant logic is a local/global control which is sampled during requests by the UBIF 
34 to determine if a LPC bus 32 request is a local or a global type request. The ROBB block generates a 
signal to indicate that the receiver LPC data output buffer 50a is busy. 

io The LPC_BIC 92a is also employed for controlling the generation of DMA addresses. The DMA 
addresses are formed in the DAR register/counter 74a and are transferred over the A bus 58a into the AB 
56a, where they are held until required for a write cycle. The DAR 74a and AB 56a are managed as a 
pipeline which is decoupled from the data transferred from the data FIFOs 40a and 40b to the DB 50a. In 
operation, the reading of a DMA command from CF(0) 48a or CF(1) 48b causes the DMA address to be 

75 loaded into the high order bits of DAR 74a, while the low order bits of DAR 74a form a counter. The 
address is then loaded into the AB 56a which in turn increments the DAR 74a counter such that the next 
DMA address is staged and ready. Each time a data word is loaded into the DB 50a and an LPC bus 32 
cycle is requested, the grant of the LPC bus 32 cycle causes a new address to be loaded into AB 56a and 
the DAR 74a counter to be incremented. This continues until the DAR 74a counter reaches 32. At this time 

20 a new DMA command is read from one of the command FIFOs 48a or 48b and its address loaded into the 
DAR 74a. 

RQRQ 1 and RQRW_2 implement identical state machines. RQRW_1 and RQRW_2 (for Receiver 

QUEUE Read/Write controller) have outputs controlling the command FIFOs 48a and 48b and status FIFOs 
44a and 44b, for channels 0 and 1 respectively. These outputs are per channel: 
25 CFREN: - Command FIFO read enable 
CFWEN - Command FIFO write enable 
CSFOE - Command/Status FIFO shared output enable 
SFREN - Status FIFO read enable 
QDONE - DMA command read done 
30 Additionally, there are two outputs: 

CRBSY - DMA command read busy (RQRW_J only), 
DARWEN - Load DMA address register (RQRW_2 only). 

Both state machines have as inputs the slave control signals: SLBSY, SA<2:0); CHAN, ADV and RW; the 
DMA command read control signals: RREQ<1:0>, BUSY<1:0>, RCTC; other control signals: DBSY, OBB, 
35 FLOW; and system reset: RESET. 

Fig. 1 1 shows the operation of RQRVV_1 and RQRW_2 state machines. The START state is entered 
from reset. If a slave cycle is pending it waits until any DBUS 42a transfer (DBSY) is complete, and if it is a 
slave read, for the output buffer (DB 50a) to be free (OBB). For a RCF or RSF slave read the state 
machines go to SLVRD-1 or, for a RCF slave write, the state machines go to SLVWR-2. Otherwise, for any 
40 other slave operation the state machines idle at START. If a slave operation is not pending, and one or both 
of the queue read request signals (RREQ<1:0>) is active, and neither of the busy signals (BUSY<1:0>) is 
active, the state machines go to either the QUERD chain or to the OELAY chain. The logic is: in RQRW_1, 
if RREQ0 is active goto QUERD-1 , else if RREQ1 is active goto IDLE-1. In RQRW_2, if RREQ0 is active 
goto IDLE-1, else if RREQ1 is active goto QUERD-1. Thus, if both RREQ0 and RREQ1 become active at 
45 the same time, with neither BUSY being active, channel 0 is given priority. If both channels are continually 
performing DMA, the channels interleave after the first choice. 

Read enables are asserted during SLVRD-1 or QUERD-1 states. Output enables are asserted for all 

SLVRD or QUERD states and FINISH. Write enable is asserted during FINISH (STATE 5 for all of the 

chains.) For DMA command reads of CF 48a or 48b the appropriate QDONE signal is asserted during 
50 FINISH, as is DARWEN. CRBSY is asserted during all DELAY or QUERD states, and finish. 

BUSY<1:0> is set by the appropriate DMA CRS 94a channel command queue read controller (RCQC 

(0) or (1)), in response to the QDONE signal, and held until the DMA burst has completed. 

In the DMA_CRS 94a the RCQCs (for Receiver Command Queue Controller) have outputs for 
controlling the lower level queue controllers, RQRW_1 and RQRW_2 for receiver channels 0 and 1, 
55 respectively. These state machines also provide outputs to notify the bus interfaces, and DMA address 
generation logic, when DMA is ready. These two DMA-related state machines are also the source of DMA 
related interrupts. They have outputs, per channel: 
INTA - Abnormal DMA interrupt 
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INTN - Normal DMA completion interrupt 

WAIT - Software status bit in DMA 60a 

RREQ - Queue read request to RQRW 

RDMA - Ready for DMA to transfer controller 

BUSY - Interlock to RQRW 
Both state machines have as inputs: 

RESET - System reset 

CQE - CF 48 empty flag 

SQE - SF 44 empty flag 

DAE - DF 40 almost empty flag 

CMDEN - Channel DMA enable from RDMA 

START - Channel start from RDMA 

DMA - latched DMA bit in DMA command 

LNK - latched LINK bit in DMA command 

INT - latched INT bit in DMA command 

BURST - latched BURST bit in status word 

BER - latched BURST ERROR bit in status word 

FLOW - FLOW bit from RDMA register 

QMABC - DMA burst done from RADC 

QDONE - Queue read done from RQRW 

Fig. 12 illustrates the state machine implemented by the RCQC elements of the DMA CRS 94a. From 

reset SO is entered, which is a quiescent state. For a START indication, with DMA enabled, for the channel 
in the DMA register 50a a transition is made to S1. In S1 the state machines wait for a command to be 
present in the DMA command queue CF 48 and, if flow mode is enabled, for a status word to be present in 
the HIPPI status FIFO SF 44. A transition is made to S2 for issuing a queue read request (RREQ). In S2 the 
state machine waits for a QDONE indication from the corresponding RQRW_1 or RQRW__2 state machine, 
and enters S3, setting BUSY. This prevents the RQRW state machines from performing any queue reads 
until the current command has completed. In S3 the DMA command is executed. Depending on the setting 
of the DMA, LINK, INTR bits in the command word read from CF 48, and if flow mode is enabled, and the 
BURST and BURST ERROR bits read from SF 44, the state machine returns to SO or S1 if no further DMA 
is to be done, or returns to S4 if further DMA is to be done, and there is not yet enough data present in the 
DF 40. If DMA is ready, S5 is entered. At the completion of the command, from either S3 or S5, INTN is 
asserted if requested. If there is an error condition in S3 then INTA is asserted, and a transition is made to 
SO, regardless of the setting of the LINK bit. From either S3 or S4 RDMA is asserted upon going to S5, 
indicating that the channel is ready for DMA. The WAIT signal is asserted in those states where the RCQC 
state machine is waiting for a resource. 

The Receiver Slave Timing Control (RSTC_J) and RSTC_2) are identical state machines and have 
outputs primarily for controlling slave read cycles. These include: 

CSB - Clear slave busy (to RSLB) 

SOBB - Set output buffer busy (to ROBB) 

D2BEN - Enable D BUS to B BUS transceiver B2D 52a 

IMKOE - INT 64a or MSK 66 output enable 

DMAOE - DMA 60a output enable 

CSR0OE - CSR0 62a output enable 

CSR10E - CSR1 62b output enable 
RSTC_2 has outputs primarily for controlling slave write cycles. These include: 

DBOE - LPC data input buffer 50a output enable 

IMKWEN - INT 64a or MSK 66a write enable 

DMAWEN - DMA 60a write enable 

CSR0WEN - CSR0 62a write enable 

CSR1WEN - CSR1 62b write enable 
Both of the RSTC_1 and RSTC__2 state machines have as inputs the slave control signals: SLBSY, 
SA<2:0>, CHAN and RW; other control signals: DBSY, CRBSY, OBB; and system reset: RESET. 

Fig. 13 shows the operation of these state machines. The START state is entered from reset. If a slave 
cycle is pending (SLBSY) the state machine waits for any DMA command read to be finished (CRBSY) and, 
if it is a slave read, for the DB 50a to be free (OBB), and for any DBUS 42a transfer in progress to be 
finished (DBSY). The slave cycle is then entered. For FIFO reads (e.g. DF 40, CF 48 or SF 44) the state 
machines start at SLAVE_1, otherwise at SLAVE-2. This is to provide an extra cycle for reading the FIFOs 
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before outputting data for four cycles. At the end of the slave cycle the state machines return to START. 
During DMA, or DMA command read cycles, the state machine idles at START. 

During a slave read cycle, output enables are asserted for all of the SLAVE-n states. During a slave 
write cycle, write enables are asserted during SLAVE-5. D2BEN, the enabling signal for D2B 52a, is 
5 asserted for all non-data FIFO operations during all SLAVE-n cycles. CSB is asserted during SLAVE-4 to 
inform the RSLB that the slave cycle is nearing completion. SOBB is asserted during SLAVE- 1 and SLAVE- 
2 read cycles to inform the ROBB that the output buffer should be indicated as busy. 

As was previously noted, the transmitter state machine BCSM 68b functions in a manner similar to the 
receiver BCSM 68a for DMA and slave read and write operations. One difference in operation is in the 
io direction of data flow during DMA. That is, the transmitter 28c performs Global memory reads as opposed 
to Global memory writes. A sharing operation of the receiver 28b input queue of the UBIF 34 is also 
performed. 

It should be noted that although the I/O Processor of the invention has been described in the context of 
a specific communications system and protocol (HIPPI) that the teaching of the invention may also be 
75 employed to advantage with a number of other communications systems and protocols. Furthermore, the 
description of the various registers and state machines is not intended to be read in a limiting sense, in that 
those having skill in the art may, based on the foregoing teaching, derive modifications to same while yet 
obtaining the same results. 
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LPC Address Bus Signal Dejlnithns appendix a 

llic LPC address bus consists of LPC ACYCIJl. LPl'_ATVPI ; .. l.l'C" AI.M:«), 1.1'C J l : N(.MI) f I4T J'IDlMli. 
LPCJ'TACiO iO)l .PCJUV, LPCJXKZK, owl 1.1'CJIMW. This bus is shared hy the four local pressors and 15 used 
to initiate global memory r/w cycles. Access to llic I .IK" address bos is gained by issuing a read request (LPC JIUHO) or 
write request (LPC_WR|iC)) to flic I. PC bus arbiter and by receiving a processor grant (I PCJ'CiMT). A desc ription of 
each address bus field is provided Mow: 

• LPC.ACYCLE conditions a valid LPC bus local address cycle, litis tine is driven by the I HUP I. PC bus arbiter to 
validate local LPC bus addresses. It is used by local LPC bus devices, such as "the IIIPPI I/O interfaces cm the I/O 
processor card to validate LPC addresses. LPC_ACYCLIi is valid for one cycle during the first half of an LPC A BUS 
cycle, Indicating that a valid LPC bus address cycle can be sampled on the following rising clock edge. 

• LPC.ATYPn specifics a valid LPC address bus cycle or IPC interrupt cycle. If IJCATYPR- I. the LPC address 
bus specifics o valid r/w request, tf LPC_ATYPB = 0, the LPC bus identifies am IPC interrupt cycle. In this case, the 
UniP interprets LPCJ.!iN(3;0) as the group select identifier, C1SI(3:fl). and LPC_A(3I:U) as the processor select mask. 
I\SM(3I:0). During IPC Interrupt cycles. LPCJIW. U'C.LOCK. and LPC.RMW arc not defined. 

• LPCj\(3t:u) specifics the 32-byte block address during I .PC r/w request cycles, thus providing a physical address range 
of I2R On. During IPC interrupt cycles (LPC_ATYPP.«0). LPC_A(3I:0) specifics Ihc processor select mask. 

20 | .PC J J ; .N(3:0) Indicates the block length during I PC read request cycles. Typically, processors issue s ingle-word read 
request cycles (i.c., IJ , C - LBN(3:0)»O). However, block-read cycles arc supported by indicating a non-zero block 
length during LPC read request cycles. Hie corresponding block address must indicate a valid starting block addrc«« 
for correct operation, and reply data is returned in proper order. I1»c block length is specified in powers of two, where 
LPCJ.F.N(3:(>)« 0,1,2 16 indicate block lengths of 1.2,4 2**I6 respectively. The current limitation imposed by 

25 the UMP is a block length of eight 256-bit words (or LPCJ45N<3:0) « 3) per local device. During IPC interrupt cycles 

(LPC,ATYPE»0), LPC_LEN(3:0) specifics the processor group select. 

• UC_PID(1:0) Indicates the requesting processor Identifier (PID) during LPC r/w 
request cycles. On a read request cycle, the PID Is saved by address consumers (i.e., 
global memory cards) and later returned along with the corresponding reply data as 
LPC HID(1:0) to uniquely Identify the destination processor. On a write request 
30 cycle, the PID is used by global memory cards to complete a decoupled, 

lock- read/lock- write cycle by a given processor, thus preventing any other processor 
from performing any memory r/w operation to the locked global » eno ^ b * n *;, ° n t * e 
processor and IOP cards, the global bus processor Identifier, LPC_PID(7:0) , Is 
composed by concatenating GBJJNITID(1:0) , GB_CARDID(3:0) , with the given LPC bus 
LPN(1:0). 

•LPC PTAC(7:0) is uaed by processors to uniquely tag multiple ^standing read 
Quests! Ake PID, m/i saved*, 

me^ * 
to re-organize data when Issuing multiple outstanding read requests. 

• LPCJIW specifics a read (I) or write (0) cycle during valid LPC request cycles. 

• LPC.LOCK conditions the current LPC r/w cycle. When inactive, it indicates a normal r/w cycle. When active," it 
Indicates a decoupled, atomic r/w cycle. In global memory mode <1. read-lock cycle requests data from global memory 
and causes the affected global memory address to be locked until a subsequent write-uulock cycle is performed by the 
same processor that issued the read lock cycle. This prevents any other processor from pcifoim'mg any r/w operation 
to the locked global memory address, thus supporting atomic global memory operations (e.g.. Icsl-and-sct. compare- 
ami-swap, fetch -and -add, etc.). In global memory mode I. a read-lock cycle causes nn atomic tcsl-and-sct operation 
at the global memory. The global memory returns the data at the specified address and then writes all I's to the entire 
256-bit word. 

• LPC_RMW identifies a partial global memory writ* cycto which requires a read -modify -write operation at the global 
memory bank. LPC JIM W should be active whenever any of mf fight 32^ data slices contains partially written dais. 
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LPC Data Bus Signal Definitions 

The data bus consists of LPCJXYCLP.. LPCJ)(255:0), LPCJli;(.U:U), l.PC_Min<7:0h LPC.M TAG(7sO) 
LPOJiDPPRR. I.PCJ-CCP.RR and LPC_P.RR l*YPP.. I"his buy is used by processors to transfer write data In llic VIWV 
5 nr l>y tfic UJllP to return global memory data to processors. Processors gain access lo the I .PC! data hus by isMtiuc a 

I.PC_WRHQ to the I .PC bus master arbiter and receiving a LPCJ'GNT. A description of each data bus field is provided 
below: 

• |.PC_DCYCIJs conditions a valid LPC bus data cycle. I*his line is driven by the UBIP LPC bus data arbiter to val- 
idate LPC bus reply cycles. Data consumers should validate read reply cycles with LPCJXTCI 11 I.PCDCYCI P. 

10 ' ti valid for one cycle during the first half of an LPC Dill IS cycle. 

• I.PC_D(255:0) is the data bus. Bach of the thirty-two data bytes may contain valid data, as indicated by the byte en- 
ables LPC_lil-(3l:0). 

• LrCJMi(3l:0) are the individual byte enahlcs. LPC_BP.(0) active indicates valid data nil 1.PC_ 0(7:0). LPCJ1F.0) 
active indicates valid data on LPC_D(I5:8), etc. During write operations, LP("_M : .(31:0) validate each of the lhirty-l wo 
data bylcs on LPC_D(255:0). |.PC_nP«(3la1) arc not defined during read reply cycles, since global memory read it- 
erations always return 256-hits of data. 

• f. PC_MiD(7:0 parries the returned processor ID during global memory reply operations indicating the dcslinntinn 
processor for the given data, l,PCJvHD(f:0) reflects the value presented on I .PCJMDf 1:11) during the corresponding 
read cycle. LPC.MIW 1:0) is inactive during processor write cycles. 
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• LPC_MTAGC7 : 0 parries the returned processor TAG during global memory reply operations. This field is optionally 
used by processors to re-organize global memory reply data when issuing multiple outstanding read requests. 
LPC_MTAG0:O) renccts the value presented on LPC_PTAGC7 :0) during the corresponding read cycle. 
LPCJv!TAGf(7:0) is inactive during processor write cycles. 

• LPC_NOCACIHs inhibits buffering of the returned data. This is returned by memory devices along with reply data 
to indicate that the data is volatile and should not be buffered or cached. The UBIP returns LPC_NOCACHIl to the 
destination processor along with the reply data. 

• LPC_ECCERR, LPC_RRRTYPE reports the result of a global memory read operation. If LPC_F.RRTYP1; is active, 
then LPC_URRTYPE indicates a corrected, single-bit error (if 0) or an uncorrectable, double-hit error (if I). These 
signals are inactive during processor write cycles. 

• LPC_GI)PP.RR reports if bad parity was detected on the global bus data lines I J*C_D(255:0) during the memory read 
reply cycle. It is only valid during UBIP to PBIP data reply cycles and should be ignored at all other times. 

LPC Control Bus Signal Definitions 

1 r»e LPC control bus consists of LPC_ACK and LPC.NAK. These shared signals are used to acknowledge a valid LPC 
address and to indicate whether LPC bus requests arc accepted or rejected. LPC_ACK and LPC_NAK are relumed two 
cycles after a valid LPC address bus cycle has been issued to a recognized LPC address. The UBIP always returns 
LPC_ACK when processors issue global memory r/w requests, as indicated by conditioning an LPC_RRr;Q or 
LPCJWREQ with an active (i.e., 0) LPC_LG indication. An invalid LPC address is indicated by the absence of both 
LPC_ACK and LPC_NAK, which implies that processors should abort the request. A description of each control bus 
signal is provided below: 

• LPC_ACK is returned by an address consumer to indicate that it has acknowledged a valid LPC address and that is 
has accepted the given r/w request. The UBIP always returns LPC_ACK when given a global address since the UBIP 
local bus arbiter only grants the LPC bus if there is room in the associated output queue tn hufTcr the global bus re- 
quest. However, local devices on the I/O processor card may not return I .PC_ACK, cither because of an unrecognized 
address or because they cannot accept the given request. 

• I.PC_NAK is returned by an address consumer to indicate that is has acknowledged a valid I .PC address but that is 
has not accepted the r/w request. The requestor should retry a NAKcd cycle. 
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LPC Bus Arbitration Signal Definitions 

Ilic LrC bus arbitration control signals consist of LPC_RRIIQ(3:0), LPCJVRUfXVO). LPCJXi(3:0), ami 
LPC_RDY(3:0). Each of the four local processors has a unique set of these control signals, thus processor (i) is given 
5 LPC_RREQ(i), LPCWREQ(i), LPC_LG(i), and LPC_RDY(i). LPC_RREQ(i). LPC_WRF.Q(i), and LPCJXUO arc 

used to gain access of the LPC bus to Issue local or global r/w requests, while LPCJlDY(i) is used by the UMF-D chip 
to pace the return of global memory block read data to each local processor. These signals arc described in more detail 
below. A description of each arbitration signal is provided below: 

• LPC_RREQ(3:0) are the unique processor read request signals. These arc used to gain access to the I. PC address bus 
70 to issue a local or global read request. I.PC_LCi(3:tl) indicates whether the request is destined for a local device (I) or 

a global device (0). LPC_RREQ(i) should be generated on the rising edge of I ,PC_CLOCK and remain asserted until 
LPC_PGNT(i) is received. 

• I.PC_WREQ(3:0) are the unique processor write request signals. These arc used to gain access to both the LPC address 
bus and LPC data bus lo issue a local or global write request. LPC J .0(3:0) indicates whether the request is destined 

15 for a local device (1) or a global device (0). LPC_WREQ(i) should be generated on the rising edge of LPC_CLOCK 

and remain asserted until LPC_PGNT(i) is received. 

• LPC_LG(3:0) arc the unique processor + Local/-Global select signals. These arc used to condition whether the current 
LPC_RREQ(i) or LPCWREQ(i) is destined for a local device (I) or a global device (0). The timing of LPCJXSQ) 
is identical to LPC_RREQ(i) and LPC_WREQ(i). 

20 ♦ LPC_PGNT(3:0) are the unique processor bus grant signals. During any given I. PC bus cycle, only one 

LPC_PGNT(i) is issued by the LPC bus arbiter. LPC.PGNT(i) is returned no sooner than one cycle after delecting 
a LPCjlREQ(i) or LPCJVREQ(i) and remains active for two clock cycles. LPC_PGNT(i) should be used directly 
lb enable the LPC address bus drivers on a given processor. If a LPC_VVR|«Q(i) was issued, then the processor should 
begin driving the LPC data bus one cycle after detecting LPC_PGNT(i). Hie LPC bus arbiter always dcasscrts 

25 LPC_PGNT(i) after two cycles, but may assert the same LPCJKJN T(i) one cycle later if the corresponding processor 

keeps LPC_RREQ(i) or LPC_WREQ(i) asserted. Thus, any given processor is granted the LPC bus at most every 
other LPC bus cycle. 

LPC_RDY(3:0) are the unique processor ready signals. LPC_RI)Y(i) indicates to the UMF that the processor is ready 
to accept read data. These are used primarily during block -read cycles lo pace the rale at which a local processor or 
3Q I/O device (e.g., the IIIPPI transmitter on the I/O processor card) accepts global memory read data. The UMF returns 

data to a device at a peak data rate of 320 MR/second, assuming 40 Mllr. and no bus contention. The local processor 
or I/O device interface can slow this rate by taking away LPC_R DY(i) upon receiving a data word. 

Interrupt Message Support Signal Definitions 

35 • LPCJPCINTR(3:0) arc the unique IPC interrupt signals. These arc generated by the UMF whenever it detects an 

IMSG cycle on the global bus which selects any of the four local processors. The UMF generates a one -clock -cycle 
long LPCJPCINTR(i) signal, which should be used by the PMF chip In set the IPC interrupt bit in the processor 
interrupt register. The UBIP can issue back-to-back LPCJPCINTR(i) signals, should there be back-to-back IMSG 
cycles that select the processor (i). 
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5 

Local Processor Card (LPC) Bus Signal Summary 
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Signal Name 


Width 






-LPC ACYCLE 
LPC ATYPE 
LPC A 
LPC LEN 
LPC PID 
LPC PTAG 
LPC aw 
LPC LOCK 
LPC RMW 


1 
1 

32 
4 
2 
7 
'1 
I 
1 


Address cycle indicator 

+ Address/-! message select 

Address bus (32-bylc block address) 

Block length 

Processor request ID 

Processor request TAG 

+Ilead/- Write select 

Atomic cycle select 

Read- modify- write signal 


TP 
IS 
TS 
TS 
TS 
TS 
TS 

1 •> 

•••c 
i 


-Lt>U bOYOLE 
LPCD 
LPC BE 
LPC MID 
LPC MTAG 
LPC ECCEBa 
LPC ERRTYPE 
LPC NOCACUE 

lpc GBPEaa 


I 

25C 
32 
2 
7 
1 
1 
I 
1 


Data cycle indicator 
Data bus 
Byte Enables 
Memory reply ID 
Memory reply TAG 
ECC error signal 

ECC error type (0=CECC, l-UECC) 
Don't cache 
GigaBus parity error 


1 3 
1 *> 

TS 
TS 
TS 
TS 
TS 
TS 


.lp<j AfJk 
-LPC NAK 


j 
I 


Bus acknoledge 
Bus no-acknolcdgc 


IS 

TS 


Total 


354 


The following signals arc unique per processor 




LK 4 LfJ 
• LPC RREQ • 
-LPC WREQ 
■ LPC PGNT 
•LPC IIDY 
•LPC IPCINTR 
+LPC ETCLK 
-LPC ETCLK 


1 
1 
1 
1 

1 
1 

2 
2 


+ Local/- Global indicator 
LPC read request 
LPC write request 
LPC bus processor grant 
Processor ready indicator 
Interrupt message interrupt 
ECL System clock 
ECL System clock 


it 

TP 

TP 

TP 

TP 

TP 

ECL 

ECL 


Total 


:i4i 


The following signals arc daisy chained 




Lhd SIN 
LPC SOUT 


i 
l 


Diagnostic bus serial in 
Diagnostic bus serial out 


IP 
TP 


total 


2 


The following signals form the GigaBus snoop bus 




U>c Gb bAcKoW 

LPC GB ACYCLE 
LPC GB ATYPE 
LPC GB RW 
LPC GB LEN 
LPC GB A 


1 
I 
1 
1 
4 

32 


CigaUus backoff signal 
GigaBus address cycle 
GigaDus +addrrss/lmcssage select 
GigaBus Read/- Write select 
CigaRus block length 
GigaBus address 


TP 
TP 
TP 
TP 
TP 
TP 


-Ll'ClltStl' 


I 


Synchronous svstcm reset 


TP 



Claims 

50 

1. Communication apparatus for coupling to a communications channel for receiving information there- 
from, the information including data Information and structure information for indicating an organization 
of the data information, comprising: 

55 means for coupling to the communications channel for receiving the information therefrom; 

first means, having an input coupled to an output of the receiving means, for storing the received data 
information without regard for the organization of the received data information; and 

19 
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second means, having an input coupled to an output of the receiving means, for storing the received 
structure information. 

5 2. Communication apparatus as set forth in Claim 1 wherein the receiving means includes means for 
coupling to a bit parallel communications channel for receiving the data information therefrom, and 
wherein the receiving means further includes means for coupling to a plurality of communications 
channel signal lines for receiving the structure information therefrom. 

w 3. Communication apparatus as set forth in Claim 2 wherein the plurality of communications channel 
signal lines include: 

a PACKET signal line for indicating, when first asserted, a START OF PACKET (SOP) condition 
wherein one or more BURSTs of data information are to be transferred over the bit parallel communica- 
75 tions channel, and for indicating, when first deasserted, an END OF PACKET (EOP) condition wherein 
no further BURSTs are to be transferred; and 

a BURST signal line for indicating, when first asserted, that a BURST comprised of one or more words 
of data information are to be transferred over the bit parallel communications channel, and wherein 

20 

the second storing means stores the SOP, BURST, and EOP indications. 

4. Communication apparatus as set forth in Claim 3 wherein there is received, for each BURST, 
information indicating a number of data words that comprise the BURST, and wherein the second 

25 storing means further stores, in association with each stored BURST indication, the information that 
indicates the number of data words that comprise the BURST. 

5. Communication apparatus as set forth in Claim 3 wherein the receiving means includes means for 
verifying an integrity of the received data information for each BURST, and wherein the second storing 

30 means further stores, in association with each stored BURST indication, information that indicates the 
integrity of the stored data information that was received during the BURST. 

6. Communication apparatus for coupling to a communications channel for transmitting information 
thereto, the information including data information and structure information for indicating an organiza- 

35 tion of the data information, comprising: 

means for coupling to the communications channel for transmitting the information thereto; 

first means, having an output coupled to an input of the transmitting means, for storing the data 
40 information, prior to transmission thereof, without regard for the organization of the data information; 
and 

second means, having an output coupled to an input of the transmitting means, for storing the structure 
information prior to the transmission thereof. 

45 

7. Communication apparatus as set forth in Claim 6 wherein the transmitting means includes means for 
coupling to a bit parallel communications channel for transmitting the data information thereto, and 
wherein the transmitting means further includes means for coupling to a plurality of communications 
channel signal lines for transmitting the structure information thereto. 

50 

8. Communication apparatus as set forth in Claim 7 wherein the plurality of communications channel 
signal lines include: 

a PACKET signal line for indicating, when first asserted, a START OF PACKET (SOP) condition 
55 wherein one or more BURSTs of data information are to be transferred over the bit parallel communica- 
tions channel, and for indicating, when first deasserted, an END OF PACKET (EOP) condition wherein 
no further BURSTs are to be transferred; and 
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a BURST signal line for indicating, when first asserted, that a BURST comprised of one or more words 
of data information are to be transferred over the bit parallel communications channel, and wherein 

the second storing means stores the SOP, BURST, and EOP indications. 

5 

9. Communication apparatus as set forth in Claim 8 wherein there is transmitted, for each BURST, 
information indicating a number of data words that comprise the BURST, and wherein the second 
storing means further stores, in association with each stored BURST indication, the information that 
indicates the number of data words that comprise the BURST. 

10 

10. Communication apparatus as set forth in Claim 8 wherein the second storing means further stores, in 
association with each stored SOP, EOP, and BURST indication, information that specifies that the 
associated stored indication, and that an immediately subsequent stored indication, are to be executed 
in sequence by the transmitting means. 

75 

11. Communication apparatus for coupling to a communications channel for transmitting information thereto 
or for receiving information therefrom, comprising: 

means for interfacing the communication apparatus to a communications channel; 

20 

means for interfacing the communication apparatus to a data processing bus including data, address, 
and control signal lines; 

first communication apparatus internal data bus means coupled to the data signal lines of the data 
25 processing bus through first buffer means, the first communication apparatus internal data bus means 
having data storage means coupled thereto for storing data received from or transmitted to the 
communications channel; 

second communication apparatus internal data bus means coupled to the first communication appara- 
30 tus internal data bus means through second buffer means, the second communication apparatus 
internal data bus means having at least one logical unit coupled thereto for storing information 
specifying the operation of direct memory access (DMA) bus cycles for transferring information to or 
from the data signal lines of the data processing bus and the data storage means; and 

35 control means having inputs responsive to the information stored within the at least one logical unit and 
an output coupled to the second buffer means for causing, (a) the second buffer means to isolate the 
first communication apparatus internal bus means from the second communication apparatus internal 
bus means during DMA bus cycles, and (b) the second buffer means to couple together the first 
communication apparatus internal bus means and the second communication apparatus internal bus 

40 means during non-DMA bus cycles so as to enable data to be stored within or read from the at least 
one logical unit by means coupled to the data processing bus. 

12. Communication apparatus as set forth in Claim 11 wherein said at least one logical unit includes first 
data storage means for storing one or more DMA commands, each command including at least a 

45 portion of an address in a data processing memory coupled to the data signal lines of the data 
processing bus and an indication of the number of times that the at least one DMA command is to be 
executed. 



13. Communication apparatus as set forth in Claim 12 wherein each command further includes information 
50 for linking the execution of the command to another command such that the command and the other 

command are executed in sequence. 

14. Communication apparatus as set forth in Claim 12 wherein the communications channel includes a 
plurality of signal lines that include: 

55 

a PACKET signal line for indicating, when first asserted, a START OF PACKET (SOP) condition 
wherein one or more BURSTs of data information are to be transferred over a communications channel 
data path, and for indicating, when first deasserted, an END OF PACKET (EOP) condition wherein no 
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further BURSTS are to be transferred; and 

a BURST signal line for indicating, when first asserted, that a BURST comprised of one or more words 
of data information are to be transferred over the communications channel data path, and wherein 

5 

the at least one logical unit further includes second data storage means for storing the SOP, BURST, 
and EOP indications associated with data stored within the data storage means that is coupled to the 
first communication apparatus internal data bus means. 

io 15. Communication apparatus as set forth in Claim 14 wherein each command further includes information 
for linking the execution of the command to indications stored within the second data storage means. 

16. Communications apparatus as set forth in Claim 11 wherein the means for interfacing the communica- 
tion apparatus to a communications channel includes a receiver interface and a transmitter interface, 

75 wherein the data processing bus has means coupled thereto for providing an input data queue and an 
output data queue for the receiver interface and an input data queue and an output data queue for the 
transmitter interface, and wherein the communications apparatus further includes means for temporarily 
assigning the output data queue of the transmitter interface to the receiver interface and for temporarily 
assigning the input data queue of the receiver interface to the transmitter interface. 

20 

17. A method for use with communication apparatus coupled to a communications channel for receiving 
information therefrom, the information including data information and structure information for indicating 
an organization of the data information, the method comprising the steps of: 

25 establishing a connection with transmitter means coupled to the communications channel for receiving 
the information therefrom; 

receiving the information from the communications channel; 
30 storing within a first memory means the received data information; and 

storing within a second memory means the received structure information. 

18. A method as set forth in Claim 17 wherein the communications channel has a plurality of communica- 
35 tions channel signal lines that include: 

a PACKET signal line for indicating, when first asserted, a START OF PACKET (SOP) condition 
wherein one or more BURSTS of data information are to be transferred over a data bus of the 
communications channel, and for indicating, when first deasserted, an END OF PACKET (EOP) 
40 condition wherein no further BURSTs are to be transferred; and 

a BURST signal line for indicating, when first asserted, that a BURST comprised of one or more words 
of data information is to be transferred over the communications channel data bus, and wherein 

45 the second memory means stores the SOP, BURST, and EOP indications. 

19. A method as set forth in Claim 18 wherein there is received, for each BURST, information indicating a 
number of data words that comprise the BURST, and wherein the second memory means further 
stores, in association with each stored BURST indication, the information that indicates the number of 

50 data words that comprise the BURST. 

20. A method as set forth in Claim 18 wherein the step of receiving includes a step of verifying an integrity 
of the received data information for each BURST, and wherein the second memory means further 
stores, in association with each stored BURST indication, information that indicates the integrity of the 

55 stored data information that was received during the BURST. 

21. A method for use with communication apparatus coupled to a communications channel for transmitting 
information thereto, the information including data information and structure information for indicating an 
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15 



organization of the data information, the method comprising the steps of: 

establishing a connection with receiver means coupled to the communications channel for transmitting 
the information thereto; 

transmitting the information to the communications channel, the step of transmitting including the steps 
of, 

reading from a first memory means the data information to be transmitted; 

reading, from a second memory means, structure information associated with the data information read 
from the first memory means; and 

organizing the transmission of the data information in accordance with the structure information. 

22. A method as set forth in Claim 21 wherein the communications channel has a plurality of communica- 
tions channel signal lines that include: 

a PACKET signal line for indicating, when first asserted, a START OF PACKET (SOP) condition 
20 wherein one or more BURSTS of data information are to be transferred over a data bus of the 
communications channel, and for indicating, when first deasserted, an END OF PACKET (EOP) 
condition wherein no further BURSTs are to be transferred; and 

a BURST signal line for indicating, when first asserted, that a BURST comprised of one or more words 
25 of data information is to be transferred over the communications channel data bus, and wherein 

the second memory means stores the SOP, BURST, and EOP indications. 

23. A method as set forth in Claim 22 wherein there is transmitted, for each BURST, information indicating 
30 a number of data words that comprise the BURST, and wherein the second memory means further 

stores, in association with each stored BURST indication, information that indicates the number of data 
words that comprise the BURST. 



35 



40 



45 



50 



55 



23 



EP 0 525 860 A2 



FIG. I 




FRAME BUFFER 



14 

CONSOLE 



FIG. 2A 

PROCESSOR CARDS 



12' 
SERVER 



20 
DISK 
ARRAY 



I/O PROCESSOR CARDS 




TO 

CONSOLE 



GLOBAL MEMORY CARDS 



EP 0 525 860 A2 



FIG. 7A 

OUT 



FIG. 7B 

OUT 



L 



46a(b) 



SOP 


X 


Li 


BURST 


LI 


Li 


BURST 


L2 


Li 


EOP 




Li 


SOP 




Li 


BURST 


L3 


LI 


EOP 


>d 


Li 


1 

FROM 1 


M 

BBUS 54b 





f 


D2 


Dl 


• 


• 


• 


• 


Dn 


Dn-I 


02 


Dl 


• 


• 


• 


• 


Dn 


Dn-I 


D2 


Dl 


• 


• 


• 


• 


Dn 


Dn-I 


1 





40c(d) 



FIG. 2B 



28b 



RECEIVER 



ASK3 



GNT3 



ASK 2 



GNT2 



FROM DBUS 42b 
28C 



TRANSMITTER 



DBUS 
42a 

DB50O 



DBUS 
42b 



DB50b 
LPC BUS 32 



REQ2 
GNT2 



IN 

QUEUE 
2 






OUT 



UBIF 



IN 

QUEUE 
3 








OUT 



REQ3 
GNT3 



34 



GLOBAL BUS 24 



GLOBAL 
MEMORY 



26 



EP 0 525 860 A2 



FIG. 3 



REQUEST(S) J~~ 

CONNECT(D) f 

REAOY(D) 
PACKET (S) 
BURST(S) 
DATA BUS(S) 



-//- 



SOP 



•i h 



-fh 



-fh 



■ih 
-//- 



1_ 
L 



// eopL[sop* 




EOP 



BURST "^^U BURST ' ,/ ~\J BURST 

J 

l-FIELD DATA LLRCI DATA LLRC2 DATA LLRC3 

BURST I LI BURST 2 L2 BURST3 L3 




FIG. 6A 

IN 





EOP 




BURST 


L3 


E 


SOP 




EOP 




BURST 


L2 


E 


BURST 


LI 


E 


SOP 


X 







440(b) 

/ 



OUT 
TO BBUS 540 



FIG. 6B 

IN 







Dn 


Dn-I 


• 
• 


• 
• 


D2 


Dl 


Dn 


Dn-I 


• 
• 
• 


• 
• 
• 


D2 


Dl j 


Dn 


Dn-I 


• 
• 


• 
• 


D2 


Dl 







400(b) 

/ 



DATA BURST 3 



DATA BURST 2 



DATA BURST 



OUT 
TO DBUS 420 



EP 0 525 860 A2 










< 



EP 0 525 860 A2 




EP 0 525 860 A2 




EP 0 525 860 A2 




EP 0 525 860 A2 



FIG. 10 



RESET 



START 



DMA-I 






DMA-2 


< 


f 


DMA-3 




f 


DMA-4 




f 


DM 


IA-5 



SLAVE- 1 




r 


SLAVE-2 






SLAVE-3 






SLAVE-4 


1 


• 


SLA! 


t/E-5 



DFC 


)-l 


: 




DF0-2 






DF0-3 






DFO-4 






DF 


0-5 



DFI 


-1 






DFI-2 




f 


DFI- 3 


> 


f 


DFI-4 






DF 


1-5 



DF< 


l-l 




, 


DF4-2 




r 


DF4-3 






DF4-4 


1 


DP 


*-5 



EP 0 525 860 A2 



FIG. II 



START 



RESET 



DELAY- 1 



SLVRD-I 



QUERD- 



DELAY-2 







DELAY-3 






DEL/ 


\Y-4 



SLVRD-2 







SLVRD-3 






SLVF 


ID-4 



SLVWR-2 







SLVWR-3 






SLVV 


VR-4 



QUERD-2 







QUERD-3 






QUEI 


3D-4 



FINISH 



EP 0 525 860 A2 



FIG. 13 



FIG. 12 



RESET 



START 


< 




i 


SLAVE-I 






SLAVE-2 






SLAVE- 3 






SLAVE-4 






SLAV 


'E-5 



— 


•a 


SO 






SI 




f 


S2 






S 


3 



RESET 



(WAIT FOR DMAEN 
a START) 



(WAIT FOR QUEUE(S) 
NOT EMPTY) 

(ISSUE RREQ) 

(WAIT FOR QDONE) 
(ISSUE BUSY) 

(EXECUTE COMMAND) 



(NOOP WITH LINK) 

(ERROR OR NOOP WITHOUT LINK) 
(DMA WITH DATA PRESENT) 



S4 






S! 


5 i 



(WAIT FOR DATA 
IN FIFO) 



(WAIT FOR DM ABC ) 



(DMABC WITH LINK) 
(DM ABC WITHOUT LINK) 



EP 0 525 860 A2 



FIG. 14 



HPR_D BUS STATES 
(ROBC RDFC) 



START 



DMA 

I 



DMA 

2 



SLAVE 



SLAVE 
2 



DMA 
3 



SLAVE 
3 



DMA 
4 



SLAVE 
4 



DMA 
5 



SLAVE 
5 



HPR.B BUS STATES 
(RSTC.1,2 RQRW_ 1,2,3) 



SLAVE 



SLAVE 
2 



SLAVE 
3 



SLAVE 
4 



SLAVE 
5 



STt 










Q READ 
1 






Q READ 
2 






Q READ 
3 






Q READ 
4 






Q F 

1 


EAD 



